Integration of visual and linguistic information in spoken language comprehension.
نویسندگان
چکیده
Psycholinguists have commonly assumed that as a spoken linguistic message unfolds over time, it is initially structured by a syntactic processing module that is encapsulated from information provided by other perceptual and cognitive systems. To test the effects of relevant visual context on the rapid mental processes that accompany spoken language comprehension, eye movements were recorded with a head-mounted eye-tracking system while subjects followed instructions to manipulate real objects. Visual context influenced spoken word recognition and mediated syntactic processing, even during the earliest moments of language processing.
منابع مشابه
Early decreases in alpha and gamma band power distinguish linguistic from visual information during spoken sentence comprehension.
Language is often perceived together with visual information. This raises the question on how the brain integrates information conveyed in visual and/or linguistic format during spoken language comprehension. In this study we investigated the dynamics of semantic integration of visual and linguistic information by means of time-frequency analysis of the EEG signal. A modified version of the N40...
متن کاملThe multimodal nature of spoken word processing in the visual world: Testing the predictions of alternative models of multimodal integration
Ambiguity in natural language is ubiquitous (Piantadosi, Tily & Gibson, 2012), yet spoken communication is effective due to integration of information carried in the speech signal with information available in the surrounding multimodal landscape. However, current cognitive models of spoken word recognition and comprehension are underspecified with respect to when and how multimodal information...
متن کاملThe impact of Persian transfer on Kurd learners’ idiom comprehension: parts of body in focus
The present study aims to consider the linguistic influence of official standard Persian language on idiom comprehension focusing on parts of body comprehension of Kurdish EFL learners. Most of the Kurds have studied in schools in which the language spoken or written has been different from their mother tongue. The present study is based on data from 92 EFL learners whom Kurdish is their first ...
متن کاملEye Movements and Spoken Language Comprehension
We present an overview of recent work in which eye movements are monitored as people follow spoken instructions to move objects or pictures in a visual workspace. Subjects naturally make saccadic eye-movements to objects that are closely time-locked to relevant information in the instruction. Thus the eye-movements provide a window into the rapid mental processes that underlie spoken language c...
متن کاملThe Bilingual Language Interaction Network for Comprehension of Speech.
During speech comprehension, bilinguals co-activate both of their languages, resulting in cross-linguistic interaction at various levels of processing. This interaction has important consequences for both the structure of the language system and the mechanisms by which the system processes spoken language. Using computational modeling, we can examine how cross-linguistic interaction affects lan...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Science
دوره 268 5217 شماره
صفحات -
تاریخ انتشار 1995